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© Display device 



© A display device for displaying information is provided with an optical system for guiding the light of the 
display device to the eye, the optical system having, in the order in the proceeding direction of the light, an 
entrance face for receiving the light, a curved face for totally reflecting the light and a reflecting face concave to 
the eye side and adapted to reflect the light toward the eye. The reflected light is transmitted by the curved face 
and reaches the eye. Thus there is obtained a compact display device with satisfactorily suppressed aberrations. 
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BACKGROUND OF THE INVENTION 
Field of the Invention 

5 The present invention relates to an observation optical system, and more particularly to an optical 

system adapted for use in a device called head-up display or spectacle-type display. 

Related Background Art 

io Conventionally there have been proposed display devices in which a cathode ray tube (CRT) or a liquid 
crystal display (LCD) is positioned close to the head of the observer whereby the observer is enabled to 
observe the image formed by such CRT or LCD, as disclosed for example in U.S. Patent Nos. 4,081 ,209 
and 4,969,724 and Japanese Patent Laid-Open Application Nos. 58-78116, 2-297516 and 3-101709. 
Japanese Patent Laid-Open Application No. 3-101709 discloses an observation device providing a relatively 

75 easily observable real image by re-focusing an original image. However, a considerably large space is 
unavoidable because an optical lens is employed for re-imaging. 

On the other hand, U.S. Patent Nos. 4,081,209 and 4,969,972 and Japanese Patent Laid-Open 
Application Nos. 58-78116 and 2-297516 disclose observation devices designed to observe a false image 
which is advantageous for compactizing the device though it is somewhat inferior in the ease of observation. 

20 Though the observation device of the latter type can achieve compactization in comparison with that of 
the real image type, the extent of such compactization cannot be said sufficient. Among the above- 
mentioned prior technologies, the one disclosed in the Japanese Patent Laid-Open Application No. 58- 
78116 is relatively advanced in terms of compactization, but the device still has a large thickness in the 
direction of the axis of the eye. It is also described that the observed image involves optical distortion, 

25 astigmatism and coma. A related technology is also described in U.S. Patent Application Serial No. 
08/317,529 filed October 4, 1994. 

SUMMARY OF THE INVENTION 

30 In consideration of the foregoing, an object of the present invention is to provide a compact and thin 
observation optical system. 

Another object of the present invention is to provide an observation optical system with reduced 
aberrations. 

The above-mentioned objects can be attained, according to an aspect of the present invention, by a 
35 display device comprising display means for displaying information, and optical means provided with 
curved faces for guiding the light from said display means to the eye, wherein said optical means hash in 
succession in the proceeding direction of the eye, a light entrance face for introducing the light, a curved 
face for totally reflecting the light and a face concave to the eye for reflecting the light toward the eye 
whereby the light reaches the eye by way of these curved faces and a compact display device can be 
40 attained with satisfactorily suppressed aberrations. 

Still another object of the present invention is to provide the above-mentioned display device with a 
visual axis detecting device thereby controlling the display state of said display means. 

Still other objects of the present invention, and the features thereof, will become fully apparent from the 
following description of the embodiments. 

45 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1A and 1B are views showing optical paths in the observation optical system of the present 
invention; 

so Figs. 2A and 2B are views showing a cross section and optical paths in the observation optical system of 
a numerical example 1 of the present invention; 

Figs. 3A and 3B are views showing a cross section and optical paths in the observation optical system of 
a numerical example 2 of the present invention; 

Figs. 4A and 4B are views showing a cross section and optical paths in the observation optical system of 
55 a numerical example 3 of the present invention; 

Figs. 5A and 5B are views showing a cross section and optical paths in the observation optical system of 
a numerical example 4 of the present invention; 
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Figs. 6 and 7 are optical cross-sectional views showing the basic principle of the observation optical 
system of the present invention; 

Figs. 8A and 8B are schematic views showing the optica! paths of an observation optical system of the 
present invention; 

5 Fig. 9 is a schematic view showing the optical path of a visual axis detecting system employed in the 
present invention; 

Figs. 10 and 11 are schematic views showing states when the display device of the present invention is 
worn by the observer; 

Figs. 12A and 12B are partial magnified views of Figs. 8A and 8B; 
w Fig. 13 is a partial schematic view in the vicinity of a prism member in an embodiment 6 of the present 
invention; 

Fig. 14 is a partial schematic view in the vicinity of a prism member in an embodiment 7 of the present 
invention; 

Fig. 15 is a partial schematic view in the vicinity of a prism member in an embodiment 8 of the present 
75 invention; 

Fig. 16 is a partial schematic view in the vicinity of a prism member in an embodiment 9 of the present 
invention; 

Figs. 17A and 17B are schematic views showing the optical paths of an observation system and a visual 
axis detecting system in an embodiment 8 of the present invention; 
20 Figs. 18A and 18B are schematic views showing the optical paths of an observation system and a visual 
axis detecting system in an embodiment 9 of the present invention; 

Figs. 19A and 19B are partial schematic views of an observation optical system and a visual axis 
detecting optical system, respectively, of the present invention; 
Fig. 20 is a flow chart showing the control sequence of the present invention; 
25 Fig. 21 is a schematic view showing selectable display areas in the present invention; 

Fig. 22 is a schematic view showing points for display area selection in the present invention; 

Figs. 23A and 23B are partial schematic views of an observation optical system and a visual axis 

detecting optical system, respectively, of the present invention; and 

Fig. 24 is a flow chart showing the control sequence of the present invention. 

30 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

At first there will be explained the basic principle of the display optical system of the present invention, 
with reference to Figs. 1 A, 1 B and 6. Display means 4, for displaying an original image such as a character 
35 or a pattern, is composed for example of a known liquid crystal display (LCD) device. There are also 
provided a first optical member 3a for guiding the light from the display means 4 to the eye of the observer, 
and a second optical member 3b. The light from the display means 4 at first enters the first optical member 
3a, then totally reflected by a totally reflecting face 1, at the eye side, of the first optical member, further 
reflected by a concave half mirror 2, concave to the eye of the observer, transmitted by the above- 
40 mentioned totally reflecting face 1 and guided to the eye. 

Figs. 1A and 1B illustrate the optical path, seen respectively from the top and from the side. 

As the concave mirror 2 is composed of a half mirror, the observer can observe the image on the 
display means 4, superimposed with the external scenery. Although the present embodiment provides a 
superimposing device, there may also be provided a device for merely observing the image display, in 
45 which case the concave mirror is composed of a mirror. 

Owing to the above-explained configuration, the present and ensuing embodiments provide extremely 
thin, compact display devices, with a thickness of the optical system in the order of 10 to 15 mm. Also 
there is achieved a wide viewing angle of ca. ±16.8° in the horizontal direction and ca. ±11.4° in the 
vertical direction. 

50 Such compactization, wide viewing angle and satisfactory optical performance are derived in the 
present embodiment from fact that a face at the observer side is utilized as a totally reflecting face and a 
transmitting face, and that the concave mirror 2 is positioned considerably eccentric with respect to the 
optical axis of the eye. In addition there ar significant contributions from facts that the totally reflecting face 
is constituted by a curved surface, particularly with optical power variable depending on the azimuthal angle 

55 as will be shown in the following numerical examples, and that the concave mirror 2 is given an optical 
power depending on the azimuthal angle. 

In particular, the optical power depending on the azimuthal angle, given to the concave mirror 2, allows 
to sufficiently eliminate the eccentric aberration resulting from the eccentric positioning thereof. Also the 
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totally reflecting face is similarly constituted by a curved surface to correct th aberrations generated by th 
concave mirror. 

In the following description, the folding direction of the light will be called the direction of generatrix, 
while a direction perpendicular thereto will be called the direction of meridian. In the present embodiment, 
5 the image angle is made wider in the meridian direction, and a relatively strong positive refractive power of 
the concave mirror generates aberrations, but the totally reflecting face is given, in the cross section along 
the meridian direction, a negative optical power to correct such aberrations. Along the optical path in the 
cross section in the meridian direction from the side of the display device or the side of the eye of the 
observer, there are provided, in succession of a face of a negative refractive power, a face of a positive 
w refractive power (concave mirror) and a face of a negative refractive power, so that the aberrations are easy 
to eliminate because of such symmetrical arrangement of the refractive powers. 

For reducing the thickness in the direction of optical axis of the eye, the elements are desirably so 
arranged that the optical system 3 stands upright. More specifically, referring to Fig. 7, there is preferably 
satisfied a condition: 

75 

ja|£20* 

wherein a is the angle (tilt angle) of the tangential line to the totally reflecting face 1 at the vertex thereof, to 
a line perpendicular to the optical axis of the eye. Outside this range, the optical system becomes thicker in 
20 the direction of the optical axis, whereby the device becomes bulkier. Also in case of superimposing an 
image on the scenery, the inclination of the optical member becomes larger to cause a distortion in the 
observed scenery. 

More preferably there is satisfied a condition: 

25 -15* £a£ 5* 

Below the lower limit, the optical system can be made thinner in a direction parallel to the optical axis of the 
eye, but the distortion becomes severer. Above the upper limit, the optical system becomes thicker in a 
direction parallel to the optical axis of the eye, and the prisms become undesirably heavy. 
30 In the present embodiment, since the totally reflecting face is concave to the eye, the light entrance 
face at the outside is constituted by a substantially same curved surface in order to prevent the distortion in 
the observed scenery. 

The concave mirror 2 is made considerably eccentric with respect to the optical axis of the eye, 
whereby an eccentric aberration is generated. However this eccentric aberration is satisfactorily corrected 

35 by constituting the totally reflecting face with a curved surface and employing, in the concave mirror 2, a 
surface of which curvature varies depending on the azimuthal angle (toric or anamorphic surface). 
Preferably an aspherical surface (toric aspherical or anamorphic aspherical surface) to attain an extremely 
satisfactory optical performances. 

With respect to the generatrix direction (y-direction) which is the direction of folding of the light and the 

40 meridian direction perpendicular thereto, the faces of the optical system are so designed to have optical 
powers variable depending on the azimuthal angle, but, in the entire system, the paraxial focal length is 
preferably substantially constant in any direction. More specifically, there is preferably satisfied a condition: 

0.9 < ivy < 1.1 

45 

wherein f y and f x are paraxial focal lengths of the entire system respectively along the cross section in the 
direction of generatrix and that in the direction of meridian. 

Also the totally reflecting face (or transmitting face) or the concave mirror is so designed, as explained 
in the foregoing, as to vary the optical power depending on the azimuthal angle thereby suppressing the 
50 eccentric aberration, and, for this purpose, there is preferably satisfied a condition: 

w<iryi 

wherein r y and r x are radii of paraxial curvature of said face respectively in the cross section in the 
55 generatrix direction and in that in the meridian direction. 

In the present embodiment, for achieving compact configuration, the concave mirror 2 is significantly 
tilted (decentralized) in the direction of generatrix which is the direction of folding of th light, the eccentric 
aberration is generated larger in the direction of generatrix than in the direction of meridian. Thus the optical 
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power in the cross section in the direction of generatrix is made weaker than that in the cross section in the 
direction of meridian, namely the radius of paraxial curvature is made longer in the direction of generatrix as 
indicated in the foregoing condition, thereby suppressing the eccentric aberration in the direction of 
generatrix. 

5 Preferably these curvatures are so selected as to satisfy: 

jra/ryj < 0.85 

Outside this range, the eccentric aberration becomes conspicuously large. 
10 On the other hand, in case the entrance face 5 is so constructed as to have varying optical power 
depending on the azimuthal angle as in the following numerical examples 2 to 4, the eccentric aberration 
can be suppressed by inversely satisfying a condition: 

M>M 

75 

For further satisfactory correction of aberrations, there are preferably satisfied conditions: 

-2.0 < 2fx/rx2 < -0.1 (a) 
-2.5 < 2f x /r x3 < -0.5 (b) 

20 

wherein r^ and r^ are radii of paraxial curvature respectively of the totally reflecting face (or transmitting 
face) 1 and the concave mirror 2, in the cross section in the meridian direction. 

Below the lower limit of the condition (a), the curvature (negative power) of the totally reflecting face in 
the meridian direction becomes stronger and the correction of distortion becomes difficult. Also below the 

25 lower limit of the condition (b), the curvature (positive power) of the concave mirror in the meridian direction 
becomes strong and the correction of astigmatism becomes difficult. On the other hand, above the upper 
limit of the condition (a), the curvature of the totally reflecting face in the meridian direction becomes to 
have a positive power, so that the totally reflecting condition becomes difficult to satisfy. Also above the 
upper limit of the condition (b), the positive power of the concave mirror in the meridian direction becomes 

30 weaker, so that the thickness of the optical system in a direction parallel to the optical axis of the eye 
becomes undesirably large. 

Furthermore, there are preferably satisfied conditions: 

-1.0<2fy/ry2<0 (c) 
35 -2.5 < 2fy/ry3 < -0.2 J (d) 

wherein f y is the focal length of the entire system in the generatrix direction, Tyz is the radius of curvature of 
the totally reflecting face, and ry3 is the radius of curvature of the concave mirror. 

Below the lower limit of the condition (c), the negative power of the totally reflecting face in the 

40 generatrix direction becomes stronger, so that the eccentric distortion becomes difficult to correct. Below 
the lower limit of the condition (d), the positive power of the concave mirror in the generatrix direction 
becomes stronger, thereby generating a large eccentric astigmatism. Also above the upper limit of the 
condition (c) relating to the totally reflecting condition in the generatrix direction, it becomes difficult to 
satisfy the totally reflecting condition. Also above the upper limit of the condition (d) relating to the power of 

45 the concave mirror in the generatrix direction, this power becomes weaker so that the entire length of the 
optical system extends in the generatrix direction. 

In the foregoing, the structures of the totally reflecting face (or transmitting face) 1 and the concave 
mirror 2 have been explained in relation principally with the curvature, but, in the present embodiment, the 
concave mirror 2 is subjected to a parallel shift, in the direction of generatrix (y-direction), from the optical 

50 axis of the eye toward the original image side ( + ) as shown in Fig. 7, whereby the eccentric distortion in 
the generatrix direction can also be suppressed. 

The eccentric distortion can be suppressed by a parallel shift satisfying: 

E £ 2.5 mm 

55 

wherein E is the amount of the parallel shift or the distance from the optical axis of the eye to the vertex of 
the concave mirror surface in the direction of generatrix (cf. Fig. 7). In the following example 1 , this amount 
E of parallel shift is equal to 5.2 mm, but it may be selected larger as in other examples for satisfactorily 
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5 



25 



45 



correcting the aberrations, and preferably satisfied a condition E £ 23 mm. 

Then, with respect to the entrance face 5, the angl Op between the entrance face and the original 
image surface constituting the display means, in the direction of generatrix, is preferably so selected as to 
satisfy a condition: 

5* £ 00 3 30° 



Below the lower limit, the entrance face and the original image surface become closer to parallel, so that 
the original image becomes undesirably thick in the direction parallel to the optical axis of the eye. On the 
w other hand, above the upper limit, the original image becomes perpendicular to the direction parallel to the 
optical axis of the eye. 

The present embodiment assumes, though not illustrated, the use of a rear light source or direct natural 
light for illuminating the original image. If the original image becomes perpendicular to the above-mentioned 
optical axis, it becomes difficult to efficiently obtain natural light for direction illumination and the false 

75 image obtained by the reflective optical system becomes darker. Consequently the present embodiment 
utilize the natural light illumination and the back light illumination selectively by detecting the external 
illumination intensity, thereby utilizing the natural light illumination in the daytime when the natural light is 
strong and the back light illumination at night. 

The display means 4 for forming the original image is composed of a liquid crystal display (LCD) 

20 device for compactizing the entire device, and the angle 7 between the optical axis at the center of the 
original image and the principal ray of the light emerging from the original image (central light beam of the 
diaphragm constituted by the eye) (cf. Fig. 7) is preferably so selected as to satisfy: 



This condition is required in case a liquid crystal display device is employed for providing the original 
image. The liquid crystal display in general has a narrow viewing angle, the light obliquely entering the 
display device and emerging therefrom is easily lost. Therefore, a bright false image cannot be obtained 
unless the light is made to enter the liquid crystal display surface and to emerge therefrom as perpendicu- 

30 larly as possible. The above-mentioned condition allows to observe a sufficiently bright image. 

Figs. 2A to 5B are optical cross-sectional views respectively of numerical examples 1, 2, 3, and 4 
explained in the following. The configuration shown in Figs. 2A and 2B employs toric aspherical surfaces in 
the concave mirror and the totally reflecting face. The configuration shown in Figs. 3A and 3B employs 
anamorphic aspherical surfaces in all of the concave mirror, totally reflecting face and light entrance face. 

35 Also the configurations shown in Figs. 4A to 5B employ anamorphic aspherical surfaces in all the optical 
faces. 

In the numerical examples 2 to 4 corresponding to Figs. 3A to 5B, the entrance face 5 is also provided 
with a curvature for attaining more satisfactory correction of aberrations. 

In the present embodiment, all the optical members are composed of acrylic resin, but glass may 
40 naturally be employed instead. 

In the following there are shown numerical examples of the present embodiment, wherein TAL indicates 
a toric aspherical lens face, and AAL indicates an anamorphic aspherical lens face. 
The TAL is defined by: 



z = f r,Tyt + A,y 4 + B,^ + C,y* + Ay 10 

l+Vl-(l+kJ(y/r*) 1 



50 wherein i indicates the face number. 
Also the AAL is defined by: 



55 
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1+V l-Kl+k^Cy/r^+d+k ^(x/r^ 
5 +AR { ( 1 + APi) y* ■+ ( 1 - APi) x*} 8 + BR { (1 + BP,) y* + ( 1 — BR) x 8 } 3 

+ CR {(1 +CP,)y*+ (1 -CP,)x*}* + DR {(1 + DP,) y 3 + ( 1 - DP,) x*} 5 

70 wherein i indicates the face number. 

A\ and B, are aspherical coefficients. 

In the following examples, at least the totally reflecting face is constructed with a face with variable 
refractive power depending on the azimuthal angle, but it may also be constructed with a rotationaliy 
symmetrical spherical or aspherical face. 

15 
20 
25 
30 
35 
40 
45 
50 
55 
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Example 1 



[mm] 



radius of 
curvature ±n 
generatrix 
direction 



r xl [mm] 

radius of 
curvature in 
meridian 
direction 



coordinates 
of vertex 



tilt angle in 

generatrix 

direction 



i=l co 






(0,0) 




0 


2 -548.019 




-74. 077 


(-0.05,19. 80) 


TAL 


0 


3 -57. 595 




-40. 526 


(5. 10,29. 14) 


TAL 


-22 


4 -548. 019 




-74. 077 


(-0. 05,19. 80) 


TAL 


0 


5 CO 






(18. 58,28. 07) 




68.90 . 


6 co 






(21.38,29. 15) 




51. 17 




K«,K« 


A,. A, 


B,,B4 






(TAL2, 4) 


613.869 


-0. 473E-5 


0.326E-7 -0. 


940B-10 


0. 991E-] 




K> 


A, 


B, 


C 


Di 


(TAL3) 


-1. 360 


0. 345E-5 


-0. 301E-7 0. 


944B-10 


-0. 113B- 



> in prism 



refractive index 
(d-line) of prism 



1.49171 



Abbe v s number 

(d-line) of prism 57.4 



focal length in 

generatrix 

direction 



f y =21 .07mm 



focal length in 
meridian 

direction f x =21 .86mm 



(numerical data) 



<* = -1.8° 
lfr/f,|= 0. 96 
|r a /r y |= 0. 7 
ZU/t^ -0.59 
2f,/ rs> = -1.08 
2f,/r„= -0. 08 
2f,/r„= 0. 73 



E= 5. 2mm 
7 = 1. 36 
0= 17.7 
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Example 2 



[mm] 



radius of 
curvature in 
generatrix 
direction 



r xl [mm] 
radius of 
curvature 
meridian 
direction 



in 



Y/ z 
coordinates 
of vertex 



tilt angle in 

generatrix 

direction 



in 


i=l oo 






(0,0) 




0 






2 -2158 074 




-99 OOA 


(0. 60.19. 83) 


A A T _ 


10.55 ' 






3 -63. 157 




-32. 870 


(34.76.30.90) 


AAL 


15.81 


" in 




4 -2158.074 




-32. 224 


(0. 60.19. 83) 


AAL 


10. 55 


15 


5 72. 108 

6 oo 




1049.744 


(14.82.29.00) 
(17.03.30.62) 


AAL 


53.74 
42.91 




20 


MIT O 


13763.5 


-3. 896 


-a 170E-4 


0. 401B-7 


CB« 
-0. 154B-8 


DR*. 
0. 223B-12 










APm 


BP*. 


CPm 


DP,.. 












-0.245 


0.416B-1 


0. 870B-1 


0. 203E-1 


25 


(AAL3) 


K» 
1.238 


Li 

0.279 


AR, 
-0. 317E-5 


BR, 
0. 248B-8 


CR, 
-0. 179B-11 


DR. 
0.608B-15 










AP, 


BP, 


CP, 


DP, 




30 








0.249 


0. 327B-2 


-0. 192B-1 


0.181E-1 




(AAL5) 


K* 

6.285 


-1. 33E-6 


ARi 
-0. 114B-4 


BR. 

-0. 402B-6 


CR. 
0. 113B-8 


DR. 
-0.411B-10 


35 








AP. 


BP. 


CP. 


DP. 












0. 273E1 


0. 155B1 


0. 160B1 


-0.644 



40 



45 



refractive index 
( d-line ) of prism 



focal length in 
1 . 49171 generatrix 
direction 



Abbe 1 s number 

(d-line) of prism 57.4 



( numerical data ) 



f y =23 . 20mm 



focal length in 
meridian 

direction f =24. 09mm 



50 



a= -10. 5° 
|f 7 /fj= 0. 96 
r,|/r T = 0. 52 



2U/t*= -1.5 
2f./r«= -1.47 
2f y /r„= -0. 02 



2f f /r n = -0. 73 
B= 34. 1mm 
7=0. 23° 
0= 10.8° 



55 
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Example 3 



r yl [nun]- 
radius of 
curvature in 
generatrix 
direction 

i = l oo 

2 -3945. 723 

3 -67. 136 

4 -3945.723 

5 123. 302 

6 oo 



r xl [mm] 
radius of 
curvature in 
meridian 
direction 



Y. z 
coordinates 
of vertex 



(0,0) 

-49.792 (3.665x20.415) AAL 

-38. 803 < 36 - 403 - 32. 01) AAL 

-49.792 (3.665,20.415) AAL 

843.030 (19.610.28.357) AAL 
(22.402,29. 859) 



tilt angle in 

generatrix 

direction 



0 

0. 04 
14. 60 

0. 04 
61.72 
52. 54 



►•in prism 



(AAL2,4) 



7202.73 



Ku.4 

-7. 709 



ASt.4 BR1.1 &?«.« DBa.4 

-0.142E-7 0.379E-7 -0. 154B-9 0.198B-12 

AP».4 BP M CPw DP w 

-0.183 0.710E-1 0.514B-1 0.201E-1 



(AAL3) K« K fl AR, BR, CR» DR, 

1.066 0.193 -0.222E-5 0.321E-8 -0. 188B-11 0.461B-15 

AP, BP, CP, DP, 

0.390 0.586B-1 -0. 185B-1 -0.222E-1 



(AAL5) K. AS. CR, DR. 

-85. 544 -916252 -0. 913B-6 -0. 204B-9 0. 117B-13 -0. 227E-10 

AP, BP, CP, DP, 

0.989E1 0. 128B1 0. 128B2 -0.952B-1 



refractive index 
(d-line) of prism 



1.49171 



Abbe's number 

(d-line) of prism 57.4 



focal length in 

generatrix 

direction 



f y =23 .71mm 



focal length in 
meridian 

direction f =23. 70mm 



( numerical data ) 



,a = 0. 05 e 
|fr/f.|= 1.0 
|r,/r T |= 0. 58 



2f,/r 0 = 
2f,/r»= 
2f,/r*= 



0.95 
-1. 22 
0. 01 



2f,/r„= -0. 71 
E= 25. 6mm 
7=1. 97° 
0 = 15.5° 
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10 



15 



20 



25 



30 



35 



r yl [mm] 
radius of 
curvature in 
generatrix 
direction 



r xl [mm] 
radius of 
curvature in 
meridian 
direction 



Y/ z 
coordinates 
of vertex 



tilt angle in 

generatrix 

direction 



= 1 CO 






(0,0) 




0 


2 -3752.581 




-50. 580 


(2. 85>23. 13) 


A A T 

AAL 


0 


3 -66. 938 




-38. 651 


(36. 37,34. 72) 


AAL 


14. 15 


4 -3752.581 




-50. 580 


(2. 85,23. 13) 


AAL 


> 

0 


c one i or 

o 306. 125 




1 AO C 4 AT 

lubb. 447 


(18. 59,31.48) 


A AT 


AQ QA 


6 oo 






(21.46,32. 54) 




51.20 


(AAL2.4) 




K^4 


AR„4 


BR* 4 


OU4 


DR*4 




•33820. 5 


-11. 350 


-0. 144B-4 


0. 398B-7 


-0. 153Br9 


0. 201E-12 








AP„4 


BP* 4 


CP* 4 


DP„4 








-0.152 


0. 730E-1 


0. 494B-1 


0. 255E-1 


CAAL3) 






AR» 


BR, 


CR, 


DRi 




1.063 


0.127 


-0. 225E-5 


0. 316B-8 


-0. 188B-11 


0. 474E-15 








AP, 


BP, 


CP, 


DP, 








0.372 


0. 568B-1 


-0. 168B-1 


-0. 208E-1 


CAAL5) 


K* 


Kd 


ARi 


BR, 


CR, 


DR. 




745.334 


-651374 


-0.656E-6 


0. 124E-6 


0.474B-12 -0. 972E-11 








AP. 


BP, 


CP. 


DP. 








0. 837E1 


-0. 273 


0. 563B1 


-0. 538 



m prism 



40 



45 



50 



refractive index 
(d-line) of prism 



Abbe f s number 
(d-line) of prism 



(numerical data) 

a= 0° 
|f y /fj= 1.0 
|r,/r y | = 0.58 



1.49171 



57.4 



focal length in 

generatrix 

direction 



f y =23 . 09mm 



focal length in 
meridian 

direction f =23 . 09mm 



2iJr«= -0.91 

ZtjTn- -1.19 

2f 7 /r n = -0. 01 



2f F /r„= -0. 69 
B= 33. 5mm 
7=1. 52° 
0 = 18. 6° 



55 



As explained in the foregoing, the present invention provides a spectacle-type display having a wide 
viewing angle of ±16.8° in the horizontal direction and ±11.4* in the vertical direction, and an extremely 
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small thickness of 10 to 15 mm in the direction parallel to the optical axis of the eye. It also provides 
satisfactorily bright optical performance. Furthermore, by constituting the concave mirror with a half- 
transmitting face, it is rendered possible to superimpose a bright false image of the original image with the 
scenery without distortion. 

5 The foregoing embodiment has been designed to obtain a wide viewing angle, but the thickness may 
be made even smaller if a somewhat narrower viewing angle is selected, since the thickness according to 
the present invention is variable depending on the viewing angle. 

In the following embodiment, there has principally been explained the optical system relating to the 
display of a head-up display device. In the following there will be explained a device based on the above- 

10 explained optical system and provided further with visual line detecting function. 

Figs. 8A and 8B are partial cross-sectional views showing the optical path of an observation system and 
a visual line detecting system in an embodiment of the present invention, while Fig. 9 is a partial plan view 
of the systems shown in Figs. 8A and 8B, and Figs. 1 0 and 1 1 are schematic views showing the mode of 
use when the device of the present invention is mounted on the head of the observer. 

is In these drawings, there are shown an observer 101, display means 4 composed for example of a liquid 
crystal display device and serving to display image information in the visible wavelength region, based on 
signals from image information supply means such as a CD-ROM 105 or a video camera 106, and an 
optical member 10 consisting of a transparent parallel-faced flat plate and incorporating therein a dichroic 
mirror 7 serving as a beam splitter for transmitting the visible light and reflecting the infrared light. The 

20 dichroic mirror 7 may however be replaced by a simple half mirror. 

A prism member 3 is provided with a front face 1 consisting of a toric aspherical surface and effecting 
total reflection in a part; a rear face 6 consisting of a transparent or opaque, flat or curved surface; a 
concave face 2 consisting of a semi-transmi ttinOvOiiJiiifror-reflecting toric aspherical surface provided in the 
prism member 3; and an entrance face 5. An optical axis (central axis) 104 coincides with the optical axis of 

25 the eye 103. The elements in the optical path from the display means 4 to the eye 103 constitute an 
observation system, for observing a false image of the image information displayed on the display means 4. 
Light source means 102 project infrared light (wavelength of about 880 nm) to the eye 103 so as to form 
Pulkinye's images, in order to detect the visual line of the eye 103 of the observer 101. 

When the infrared light from the light source means 102 is projected onto the eye 103 of the observer 

30 101 as shown in Fig. 8B, an imaging optical system (imaging lens) 8 forms a corneal reflected image, 
formed by the light reflected from the cornea of the eye 103, and images of pupil etc. on an image sensor 9 
such as a CCD, through the prism member 3 and the dichroic mirror 7 of the optical member 10. 
The imaging lens 8 is provided independently from the observation system for observing the false image of 
the image information of the display means 4. The elements in the optical path from the light source means 

35 102 to the image sensor 9 by way of the eye 103 constitute a visual line detecting system for detecting the 
visual line of the eye 103 of the observer 101. In the present embodiment, the elements of the observation 
system and the visual line detecting system are designed as explained in the foregoing, thereby facilitating 
the compactization of the entire system incorporating these two systems. 

In the following there will be explained, with reference to Figs. 8A and 8B, the observation system for 

40 observing the false image of the image information displayed on the display means 4. In the present 
embodiment, a visible light beam based on the image information displayed on the display means 4 is 
transmitted by the dichroic mirror face 7 of the optical member 10 and is introduced into the prism member 

3 through the entrance face 5 thereof. It is then totally reflected by the front face 1 of the prism member 3, 
then reflected and condensed by the concave face 2, further transmitted by the front face 1 and guided to 

45 the eye 103 of the observer 101. In such configuration, the curvatures of the front face 1 and the concave 
face 2 are so suitably selected that a false image of the image information displayed on the display means 

4 is formed in front of the observer 101, without a primary image plane for intermediate image formation. 

As explained above, in the present embodiment, the observation system is constructed as false image 
type, whereby the observer 101 observes the false image of the image information. It is also possible, in the 

50 present embodiment, to constitute the concave face 2 with a semi-transmitting surface and the rear face 6 
with a transmitting surface, and suitably selecting the curvature of the rear face 6, thereby spatially 
superimposing the external image information and the fals image of the image information of the display 
means 4 for observation in a same viewing field with same visibility. 

In the observation system of the present embodiment, in displaying the image information on the 

55 display means from the image information supply means such as a CD-ROM 105 or a video camera 106 
held by the observer 101 as shown in Figs. 10 and 11, the visual line information of the eye of the observer, 
obtained by the visual line detecting system, is utilized for various controls, such as auto focusing (focusing 
of the video camera), electronic zooming (electrical enlargement of the information in the direction of the 
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visual line), zooming (calculation of the focal length f of the video camera for obtaining an image frame size 
extracted by the visual line and matching to said focal length), and menu selection (light metering, flash 
panorama size etc.) selected by the visual line. 

In the following there will be explained, with reference to Fig. 9, the visual line detecting system for 
5 detecting the visual line of the eye 103 of the observer 101. The eye 103 of the observer 101 is illuminated 
with the infrared light from the light source means 102, and the infrared light reflected by the cornea of the 
eye 103 is transmitted by the front face 1 of the prism member 3, then reflected by the concave face 2, 
further totally reflected by the front face_1,4ransmitted-by^the entrance face 5 and guided into the optical 
member 10. It is then reflected by the^dichroic mirror facej^ thereof, totally reflected by a face 10a thereof 
70 and is guided to the image sensor 9 through-the~!maging-l6ns 8. 

The imaging lens 8 forms the corneal reflected image and the images of the pupil etc. of the eye 103 
on the image sensor 9, and the visual line of the eye 103 is detected from the signal of said image sensor 
9. 

In the present embodiment, the visual line of the eye is detected by a method disclosed for example in 

75 the Japanese Patent laid-Open Application Nos. 1-274736 and 3-11492 of the present applicant. 

Figs. 12A and 12B are schematic cross-sectional views of the prism member 3 employed in the present 
embodiment. It is employed in this case as an observation system, but, in case it is employed as the visual 
line detecting system, the optical functions remain some except that the optical path is reversed. A light 
beam 4a, perpendicularly emitted from the display face of the display means 4 is transmitted by the 

20 entrance face 5 of the prism member 3 and enters the toric aspherical front face 1 with an incident angle at 
least equal to 43*, thereby being totally reflected by said front 1. The light beam 4a is then introduced into 
the toric aspherical concave face 2 with an incident angle not exceeding 43 • , thereby being reflected by 
the concave face and is emitted from the front face 1 . 

The front face 1 is curved, and effects total reflection in a part and transmission in another part. It is 

25 therefore equivalent to two curved surfaces, and, in combination with the concave face 2, there is 
constituted a reflective optical system having three curved surfaces. In this manner the focal length of the 
entire optical system is shortened (20 to 25 mm in the following numerical examples), whereby the entire 
optical system can be compactized. 

In the present embodiment, a toric surface, a toric aspherical surface or an anamorphic aspherical 

30 surface with variable refractive power, i.e. variable curvature, depending on the azimuthal angle is employed 
in the front face 1 , the concave face 2 and the entrance face 5 in the observation system and the visual line 
detecting system 5, whereby satisfactory correction is attained for the ^ccen tric=aberration generated when 
the angle between the incident light and the emerging light of thesconcave mirror 2 fe^made large in order 
to reduce the size of the entire optical system. ^ . — — 

35 The curvatures of the front face 1 and the rear face 6 are so selected as to constitute a meniscus lens 
having a small refractive power for the light passing through these faces, whereby the external image 
information such as the external scenery can be satisfactorily observed through the rear face 6. 

Also in the cross section in the meridian direction, the front face 1 is given a negative refractive power, 
in order to correct the aberrations generated by the positive refractive power of the concave face 2. The 

40 meridian direction means a plane perpendicular to the plane containing the optical path from the center of 
the image on the display means to the designed center of the eye (i.e. direction perpendicular to the plane 
of Figs. 12A and 12B). 

Also in the present embodiment, the front face 1 may be given a negative refractive power in the cross 
section in the generatrix direction, for attaining an effect similar to that of the negative refractive power in 
45 the cross section in the meridian direction. The cross section in the generatrix direction means a plane 
containing the optical path from the center of the image of the display means to the designed center of the 
eye (i.e. plane of Figs. 12A and 12B). 

There is satisfied a condition: 



wherein a is the tilt angle, as shown in Fig. 12B, between a tangential line L at the vertex of the front face 1 
in the cross section in the generatrix direction and a line m perpendicular to the optical axis 104 of the eye 
and passing the vertex of the front face 1 . As indicated by the condition (1 ), the angle a is selected smaller 
55 than 20 • , thereby reducing the distortion in observation of the false image of the image information of the 
display means 4 and the external image information such as external scenery in spatially superimposed 
state, and reducing the thickness of the prism in the axial dir ction. 
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In the following there will b explained other features of the observation system and the visual line 
detecting system including the elements (entrance face 5, front face 1 and concave face 2) provided in the 
optical path from the display means 4 to the eye 103. 

(2-1) In the present embodiment, the imaging magnification 0 of the imaging lens 8 from the eye 103 to 
5 the image sensor 9 is defined by: 

0.02 < \fi\< 0.18 (2) 

Above the upper limit of the condition (2), the magnification of the eye image becomes too large, so that 
w the effective diameter of the image sensor becomes undesirably large. Also below the lower limit of the 
condition (2), the focal length of the visual line detecting system has to be made shorter, whereby 
various aberrations are generated and a satisfactory eye image cannot be obtained. 
(2-2) Also there is satisfied a condition: 

75 0.9 < jyfxj< 1.1 (3) 

wherein f y , f x are focal lengths of the entire system respectively in the generatrix cross section and the 
meridian cross section, thereby maintaining a substantially constant focal length for the entire system in 
any azimuthal angle and dispensing with the correction for the aspect ratio, in the generatrix direction 
20 and the meridian direction, of the image information displayed on the display means. 
(2-3) Also there is satisfied a condition: 

N < jRyj (4) 

25 wherein R y , R x are radii of paraxial curvature of the concave face 2 respectively in the generatrix cross 
section and the meridian cross section. For compactizing the observation system, the optical axis of the 
concave face has to be significantly tilted clockwise, in the generatrix cross section, from the optical axis 
of the eye, but such configuration generates a large eccentric aberration. On the other hand, in the 
meridian cross section, such eccentric aberration is not generated much because there is little room for 

30 such eccentricity. In the present embodiment, therefore, the radius R y of curvature in the generatrix cross 
section is selected larger than that R x in the meridian cross section as indicated by the condition (4), or 
the refractive power in the generatrix direction is selected weaker than that in the meridian direction, 
thereby suppressing the eccentric aberration in the generatrix cross section. 

In the present embodiment, for the purpose of correction of the eccentric aberration, the condition (4) 

35 is preferably set as follows: 

|Rx/R y | < 0.85 (5) 

(2-4) When the entrance face 5 of the prism member 3 is constituted by a toric surface or an anamorphic 
40 surface, there is selected a condition: 

|Ry5| < jRxsj (6) 

wherein Rys and Rxs are radii of curvature respectively in the generatrix cross section and the meridian 
45 cross section. The entrance face 5 generates relatively little eccentric aberration in the generatrix cross 
section. Thus, though the concave face 2 and the front face 1 cannot be given strong refractive forces in 
the generatrix cross section, the entrance face 5 is given a strong refractive force in the generatrix cross 
section, thereby realizing a substantially constant focal length in any azimuthal angle in the entire 
system. 

so (2-5) Satisfactory optical performance is realized in the meridian cross section by giving a negative 
refractive power to the totally reflecting area of the front face 1, a positive refractive power to the 
concave face 2 and a negative refractive power to the transmitting area of the front face 1 . In case the 
entrance face 5 has a refractive power, it is preferably selected as positiv in the generatrix cross 
section, in order to cover the deficiency in the positive refractive power in the generatrix cross section in 

55 the entire system. 

(2-6) Satisfactory optical p rformance is realized in the generatrix cross section by giving a negative 
refractive power in the totally reflecting area of the front face 1 , and a positive refractive power to the 
concave face 2. In case the entrance fac 5 has a refractive power, it is selected as positiv in the 
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meridian cross section, thereby reducing th aberrations in the meridian cross section. 
(2-7) In th meridian cross section, there are satisfied condition: 

O.K iajRtfj < 2.0 (7) 
5 0.5 < I2VRX2I < 2.5 (8) 

wherein R x i, Rx2 are radii of curvature respectively of the totally reflecting area of the front face 1 and of 
the concave face 2, and f x is the focal length of the entire system. The upper limits of the conditions (7), 
(8) correspond to stronger refractive forces of said curvatures, while the lower limits correspond to the 

w weaker refractive forces. Above the upper limit of the condition (7), the distortion aberration becomes 
difficult to correct, and, below the lower limit, the totally reflecting condition becomes difficult to satisfy. 
Also above the upper limit of the condition (8), the astigmatism becomes difficult to correct, and, below 
the lower limit, the entire optical system becomes larger, particularly with a larger thickness in the 
direction parallel to the optical axis. 

75 (2-8) In the generatrix cross section, there are satisfied condition: 

0< |2f y /R y1 j< 1.0 (9) 

0.2 < |2fy/Ry2| < 2.5 (10) 

20 wherein R y t, Ry2 are radii curvature respectively of the totally reflecting area of the front face 1 and the 
concave face 2, and f y is the focal length of the entire system. The upper limits of the conditions (9) and 
(10) correspond to stronger refractive powers of said curvatures, while the lower limits correspond to 
weaker refractive powers. Above the upper limit of the condition (9), the eccentric distortion aberration 
becomes difficult to correct, while, below the lower limit, it becomes difficult to satisfy the totally 

25 reflecting condition. Also above the upper limit of the condition (10), eccentric astigmatism is generated 
significantly, and, below the lower limit, the length of the entire lens increases and the entire optical 
system becomes undesirably bulky. 

(2-9) The concave face 2 is shifted in parallel manner, in the generatrix cross section (Y-direction), from 
the optical axis 104 of the eye toward the display means 4, thereby suppressing the eccentric distortion 
30 aberration in the generatrix cross section. The amount E of parallel shift (distance from the optical axis 
104 to the vertex of the concave face 2 as shown in Fig. 12B) is so selected as to satisfy: 

25 5 E (11) 

35 thereby satisfactorily correcting the eccentric distortion. 

(2-10) The tilt angle a in the condition (1) is so maintained as to satisfy: 

-15° £a£ 5* (12) 

40 for effectively compactizing the entire optical system. Below the lower limit of the condition (12), the 
image information becomes distorted significantly, while, above the upper limit, the prism member 3 
becomes thicker in the direction of the optical axis 104. 
Figs. 13 to 16 are schematic views showing modifications in a part of the visual line detecting system in 
the vicinity of the prism member 3. 
45 An embodiment shown in Fig. 13 is different from the foregoing embodiments in that the optical 
member 10 is provided between the eye 103 of the observer and the prism member 3, with corresponding 
positioning of the imaging lens 8 and the image sensor 9. This embodiment provides an advantage of exact 
detection of the visual line, since no eccentric face is involved in the visual line detecting system. 

In an embodiment shown in Fig. 14, the dichroic face 7 is provided in inclined manner inside the prism 
so member 3, with corresponding positioning of the imaging lens 8 and the image sensor 9. This embodiment 
is featured by a reduced number of components, leading to further compactization of the entire optical 
system. 

In an embodiment shown in Fig. 15, the optical member 10 is positioned farther than the prism member 
3 from the eye 103. Also the concave face 2 is pr oyidedjvith^a dic hroic film reflecting the visible light and 
55 transmitting the infrared light. ThlTopticarmember 10 is provided with an inclined reflecting face 11, having 
a semi-transmitting, totally reflecting or dichroic film, and the imaging lens 8 and the image sensor 9 are 
positioned accordingly. The state of mounting of the device of the present embodiment, on the head of the 
observer, is schematically illustrated in Figs. 17A and 17B. 
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In an embodiment shown in Fig. 16, the optical m mber 10 consisting of a parallel-faced flat plate is 
replaced by a dichroic mirror 7, transmitting the visible light and reflecting the infrared light, provided on the 
entrance face 5 of the prism member 3, and the imaging lens 8 and the image sensor 9 ar positioned 
accordingly. The state of mounting of the device of the present embodiment, on the head of the observer, is 
5 schematically illustrated in Figs. 18A and 18B. 

Display devices utilizing the visual line detecting systems of the above-explained embodiments can be 
directly applied to so-called head-up display device. 

In the following there are shown numerical examples of the present embodiment, wherein elements of 
the system are represented as follows, with reference to Figs. 8A, 8B and 9: 
w (1) eye 103 being selected as the original point (0, 0) of the coordinate system; 

(2) in the visual line detecting system, in tracing the light from the eye 103; 
= 1 eye 

= 2 front face 1 (transmitting face) 
= 3 concave face 2 
75 i = 4 front face (totally reflecting face) 

= 5 entrance face 5 

= 6 entrance face of optical member 1 0 
= 7 dichroic face 
= 8 

20 i = 9 exit face of optical member 10 

= 10 entrance face of imaging lens 
= 1 1 exit face of imaging lens 
= 12 image sensor in the observation system; 
= 8 entrance face of Image information 
25 j = 9 display face of image information 

(3) TAL indicates a toric aspherical surface; and AAL indicates an anamorphic aspherical surface. 
The TAL is defined, in the generatrix (Y - Z) cross section, by the following aspherical equation: 



30 



z=- 



y 2 /ryi 



1+v/l-d+ki) (y/ryi) 2 



4- Aiy 4 + Biy 6 + Ciy 8 + Diy 10 



35 wherein i indicates the face number, and is spherical in the meridian (X - Z) cross section. 
Also the AAL is defined by: 



40 



z = 



y^/riy + xVrix 



45 



1+ Vl-Kl+kyi) (y/ryi) 32 +(l+kxi) (x/rxi) 2 } 
+ ARi{(l+APi)y 2 +(l-APi)x 2 } 2 + BRi{(l+BPi)y 2 +(l-BPi)x 2 } 3 
+ CRi{(l+CPi)y 2 +(l-CPi)x 2 } 4 + DRiUl+DPi^+d-DPOx 2 } 5 



wherein i indicates the face number, 
so Also in the present invention, AL indicates a rotationally symmetrical aspherical surface, which is 
defined by: 



ss 



z=- 



y 2 /ryi 



l+>/l-(i+ki)(y/ryi) 2 



+ Aiy 4 + Biy 6 + Ciy 8 + Diy 
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wherein i indicates the face number. The surface vertex coordinate (Y, Z) is an absolute coordinate when 
the vertex of the eye surface is taken as (0, 0). The tilt angle in the generatrix cross section indicates the tilt 
angle of the optical axis of each face, with respect to the optical axis of the eye. said angle being taken 
positive anticlockwise. A reflecting face (including totally reflecting face) is indicated by a suffix M. nd and 
p6 respectively indicate the refractive index and the Abbe's number for d-line. 
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[Nemerical Example 5] 



(Visual line detecting system) 



Radius of 
curvature 
in generatrix 
cross section 



Radius of 
curvature 
in meridian 
cross section 



Vertex 

coordinate Y, Z 



Tilt angle in 
generatrix 
cross section 



1 oo 

2 -514.575 -52.805 

3 -63.546 -42.575 

4 -514. 575 ~ 52 - 805 

5 °° 

6 00 

7 «> 

8 a> 

9 00 

10 -1. 889 

11 1. 426 

12 00 

(Observation system) 

■ 8 CO 

■ 9 «> 



(0,0) 
(0, 21. 15) 
(26.30,35.96) 
(0,21. 15) 
(20.72,28.06) 
(21. 18,28.27) 
(23.41, 28.20) 
(21. 18,28.27) 
(24.93,20.09) 
(26. 90, 21. 14) 
(29. 35, 19.41) 
(30.51, 18.95) 

(23.91. 29.52) 
(24. 98,30.01) 



0 0 
0 

-3. 33 
0 

65. 37 
65.37 
30. 37 
65. 37 
-54. 64 
-54. 64 
-54. 64 
-51. 60 

65. 37 
59. 37 



eye 
TAL 
TAL-M 
TAL-M 



M 
H 



nd=l. 49171 
vd=57.4 



nd-1. 51633 
vd=H..l 



*** ~] nd=l. 49171 
AL J vd=57.4 

image sensor 



nd=l. 51633 
image information 
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(TAL, AL data) 

TAL2.4:K=460.670. A=-0. 227E-5. B=0. 179E-7. C=-0. 453E-10. D=0. 429E-13 

TAL3 : K=l. 105. A=-0. 709E-6. B=-0. 273E-8. C=-0. 191E-11. D=0. 631E-15 

ALIO : K=-3. 858, A=0. 851E-2. B=-0. 101. C=0. 149. D=-0. 755E-1 

ALII : K=-0. 113. A=0. 195. B=-0. 590. C=0. 471. D=-0. 138 

(1) a=0 (5) |Rxl/Ryl|=0. 10 (8) 2fx/Sx2— 1. 09 (11) E=26. 3 

(2) | £ | =0.10 |Rx2/Ry2|=0.67 (9) 2fy/Ryl=-0. 04 

(3) | fy/fx 1=1.00 (7) 2fx/Rxl=-0. 88 (10) 2fy/Ry2=-0. 36 
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[Nemerical Example 6] 



(Visual line detecting system) 

r yi r *i 

Radius of Radius of 

curvature curvature 

in generatrix in meridian 

cross section cross section 

Vertex Tilt angle in 

coordinate Y, Z generatrix 

cross section 



i= 1 oo 




0 


eye 




1= 2 -514. 575 0£.ouo 


\V 9 61* LDJ 


0 


TAL 


na-i. 451171 


i= 3 -63.546 -42.575 


(26.30,35.96) 


-3.33 


TAL 


*d=57.4 


i= 4 -514.575 -52.805 


(0, 34. 15) 


0 


TAL _ 




i= 5 oo 


(0, 37. 15) 


45 


II 




i= 6 -1.889 


(-13.0,37. 15) 


90 


AL — 


nd=l. 49171 


i= 7 1.426 


(-16. 0,37. 15) 


90 


AL _ 


U Ul. 1 


i= 8 oo 


(-17.27.37.15) 


90 


image 


sensor 


( Observation system) 










i= 3 -63.546 -42.575 


(26.30.35.96) 


-3.33 


TAL-H 


nd=l. 51633 


i= 4 -514.575 -52.805 


(0. 21. 15) 


0 


TAL-M 


j/d=64.1 


i= 5 oo 


(20.72,28.06) 


65.37 






i= 6 oo 


(24. 05,29.59) 


54.25 


image 


information 


(TAL, AL data) 










TAL2, 4:K=460. 670. A=-0. 227B-5. B= 


0. 179B-7. O-O. 453E-10. D-0. 429B-13 




TAL 3 : K=l. 105. A=-D. 709E-6. B= 


0. 273E-8. C=-0. 191B-11. D=0.631B-15 




AL6 : K=-3. 858. A=0. 851B-2. B= 


-0. 101. C=0. 149. 


D=-0. 


755B-1 




AL7 : K=-0. 113. A=0. 195. B= 


-0. 590. C=0. 471. 


D=-0. 


138 




(1) a=0 (5) |Rxl/Ryl| = 


=0.10 (8) 2fx/Rx2= 


-1.09 (11) 


B=26. 3 




(2) | 0 | =0.05 |Rx2/Ry2|= 


=0.67 (9) 2fy/Ryl= 


-0. 04 






(3) | fy/fx | =1. 00 (7) 2fx/Rxl=- 


■0.88 (10)2fy/Ry2= 


-0. 36 
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[Nemerical Example 7] 



(Visual line detecting system) 



Radius of 
curvature 
in generatrix 
cross section 



Radius of 
curvature 
in meridian 
cross section 



Vertex 

coordinate Y, 



Tilt angle in 
generatrix 
cross section 
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(AAL, AL data) 
AAL2. 4: 

Ky=-13763. 5. AR=-0. 170E-4. BR=0. 406E-7. CR=-0. 154E-9. DR=0. 223B-12 

Kx=-3.896. AP=-0. 245. BP=0. 416E-1, CP=0. 870E-1, DP=-0. 203E-1 
AAL3: 

Ky=l. 238. AR=-0. 317E-5, BR=0. 248E-8. CR=-0. 179E-11. DR=0. 608E-15 

Kx=0. 279. AP=-0. 249. BP=0. 327E-2. CP=-0. 192E-1. DP=0. 181E-1 
AAL5: 

Ky=6. 825. AR=-0. 114E-4. BR=-0. 402E-6. CR=0. 113E-8. DR=-0. 4UE-10 

Kx=-1.33E+6, AP=0. 273E+1. BP=0. 155E+1. CP=0. 160E+1. DP=-0. 644 
ALIO : K=-3. 858. A=0. 851E-2, B=-0. 101. C=0. 149. D=-0. 755E-1 
ALII : K=-0. 113. A=0. 195. B=-0. 590. C=0. 471. D=-0. 138 

(1) a=-10.5 (5)|Rxl/Ryl|=0. 01 (8) 2fx/Rx2=-l. 47 (11) E=34. 8 

(2) | /9 |=0.12 |Rx2/Ry2|=0. 52 (9) 2fy/Ryl=-0. 02 

(3) | fy/fx | =0.96 (7) 2fx/Rxl=-l. 5 (10) 2fy/Ry2=-0. 73 
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[Nemerical Example 8] 
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(AAL, AL data) 
AAL2.4: 

Ky=-361850. AR=-0. 183B-4. BR=0. 381B-7. CR=-0. 114E-9. DR=0. 153E-12 
Kx=-13. 802. AP=-0.317. BP— 0..602B-1. CP=0. 272B-1. DP=-0. 211B-1 
AAL3: 

Ky=l. 227. AR=-0. 209R-5. BR=0. 308B-8. CR=-0. 190B-11. DR=0. 505B-15 
Kx=0. 172. AP=0.472. BP=0. 5S3B-1. CP=-0. 265B-1. DP=0. 751E-2 
AAL5: 

Ky=987000. AR=-0. 871E-5. BR=-0. 264E-6. CR=0. 469B-13. DR=0. 137E-11 
Kx=-70. 169. AP=4L 763. BP=-0. 395. CP=0. 183B+2. DP=-0. 988 
AL7 : K=-3.858. A=0. 851E-2. B=-0. 101. C=0. 149. D=-0. 755E-1 
AL8 : K=-0. 113. A=0. 195. B=-0. 590. C=0. 471. D=-0. 138 

(1) a =1.5 (5) |Rxl/Ryl|=0.005 (8) 2fx/Rx2=-l. 22 (11) E=33. 1 

(2) I 0 1=0.10 |Rx2/Ry2|=0. 56 (9) 2fy/Ryl=-0. 46 

(3) I fy/fx I =1.00 (7) 2fx/Rxl=-0. 93 (10) 2fy/Ry2=-0. 61 
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[Nemerical Example 9] 
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(AAL, AL data) 
AAL2, 4: 

Ky=-387540, AR=-0. 183E-4, BR=0. 378E-7, CR=-0. 117E-9. DR=0. 158E-12 
Kx=-20. 897. AP=-0.300, BP=-0. 548B-1. CP=0. 326E-1. DP=-0. 228E-1 
AAL3: 

Ky=l. 213, AR=-0. 22*E-5. BR=0. 305E-8, CR=-0. 190E-11. DR=0. 500E-15 
Kx=0. 165, AP=-0. 464, BP=0. 630E-1. CP=-0. 251E-1, DP=0. 380E-2 
AAL5: 

Ky=559.028. AR=-0. 675E-5. BR=0. 182E-6. CR=0. 212E-12. DR=-0. 189E-10 
Kx=-99429.4. AP=0. 486E+1, BP=-0. 125E+1. CP=0. 111E+2. DP=-0. 789 
ALII : K=-3, 858, A=0. 851E-2, B=-0. 101. C=0. 149, D=-0. 755E-1 
AL12 : K=-0. 113. A=0. 195, B=-0. 590. C=0. 471. D=-0. 138 

(1) a =0.28 (5)|Rxl/Ryl|=0. 005 (8) 2fx/Rx2=-l. 26 (11) E=33. 0 

(2) | 0 |=0.11 I Rx2/Ry2 1=0.55 (9) 2fy/Ryl=-0. 005 

(3) | fy/fx | =1.00 (7) 2fx/Rxl=-0. 95 (10) 2fy/Ry2=-0. 69 



According to the present invention, as explained in the foregoing, there is provided a display device, 
such as a head-mount display, enabling compactization and provided with a visual line detecting system 
capable of controlling, based on the visual line information, the observation state of the image information 
displayed by the display means in the observation system, by suitably designing said observation system 
for observing the image information displayed by the display means and the visual line detecting system 
provided, in a part of the observation system, for detecting the visual line of the observer. 

In the following there will be explained the control of the display device utilizing the above-explained 
visual line detecting function. 

Figs. 19A and 19B show the optical paths respectively of the observation system and the visual line 
detecting system in the optical system of the present invention. 

Display means 4 displays, on a display face thereof, an image such as a character or a pattern, with 
visible light, a flat prism 10 is composed of two adhered prisms, of which junction plane is provided with a 
dichroic mirror transmitting the visible light and reflecting the infrared light for visual line detection. The 
prism 10 has a lateral wall 13. 

A first optical member 3A is provided with a flat face 5, a curved or aspherical face 1, and a half- 
transmitting or totally reflecting, spherical or aspherical face 2a of a positive refractive power. In the present 
embodiment, the face 2a is composed of a half mirror. A second optical member 3B is provided with a 
transparent or opaque, flat or curved face 6, and a concave face 2b, consisting of a half-transmitting or 
totally reflecting, spherical or aspherical surface same in shape as the face 2a. The face 2a of the first 
optical member 3A and the face 2b of the second optical member 3B are adhered to constitute a single 
prism block 3. The adhered face 2 constitutes a half mirror. 

There are also provided an imaging lens 8 for visual line detection, an image sensor 9 consisting of a 
CCD, and a light source 12 for detecting the visual lin of the eye E of the observer, by illuminating the 
frontal part of said ey E with invisible (infrared) light. 
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A visual line detecting circuit 14 detects the visual line information of the eye E. Discrimination means 
15 discriminates whether the visual line of the observer is fixed for a predetermined time in a substantially 
same direction. Control means 16 receives image signals from an image information source S and displays 
an image on the display face of the display means 4 under controlled display state based on the visual line 
5 information from the discrimination means 15. 

The prism 10 and the first optical member 3A constitute a part of the image observation optical system, 
and the image observation optical system and the second optical member 3B constitute a part of the 
observation optical system. 

In the following there will be explained, with reference to Fig. 19A, the function of the observation 
10 optical system of the present embodiment. The control means 16 displays the image on the display face of 
the display means 4, based on the signals from the image information source S. The light beam (visible 
light beam) from the image displayed on the display means 4 is transmitted by the dichroic mirror 7 of the 
prism 10, then introduced into the prism block 3 through the face 5, totally reflected by the face 1, then 
reflected and condensed by the half mirror surface 2, and emerges from the face 1 to enter the pupil 0 of 
75 the observer. Thus a false image Y of the image displayed on the display means 4 is formed in front of the 
observer, and can be observed by the observer. 

On the other hand, the light beam from the external scenery G is introduced into the face 6 of the prism 
block 3, then transmitted by the half mirror 2 and emerges from the face 1 to reach the pupil of the 
observer, who can thus observe the external scenery. Thus the observer observes, within a same viewing 
20 field, the false image Y of the image displayed on the display means 4 and the external scenery in 
superposition. 

In the following there will be explained the function of the visual line detecting optical system of the 
present embodiment. Referring to Fig. 17B, the light reflected and scattered by the frontal part of the eye E 
of the observer, illuminated by the infrared light from the light source 12, is introduced into the face 1 of the 

25 prism block 3, then reflected by the half mirror 2 toward the face 1, then totally reflected by the face 1 and 
emerges from the face 5 to enter the prism 10. It is then reflected by the dichroic mirror 7, totally reflected 
by the lower face of the prism 10 and emerges from the face 13. It is then transmitted by the imaging lens 
8 for visual line detection, thereby forming an image of the frontal part of the eye on the image sensor 9. 
The light reflected by the cornea of the eye E forms Purkinje's images, while the light scattered by the pupil 

30 forms an image of the pupil. The visual line detecting circuit 14 calculates the direction of the visual line of 
the observer, based on the Purkinje's images and the pupil image obtained from the image sensor 9. This 
detection can be achieved for example by a method disclosed in the Japanese Patent Laid-Open 
Application No. 3-109029 of the present applicant. 

The light source 12, the first optical member 3A, the prism 10, the imaging lens 8, the image sensor 9 

35 and the visual line detecting circuit 13 constitute a part of the visual line detecting means. 

Fig. 20 is a flow chart showing the control sequence of the present invention, for arbitrarily and 
selectively varying the size and position of the false image of the displayed image, to be superimposed with 
the external image, by the control means 16 of the present invention according to the visual line information 
of the eye E of the observer. 

40 Fig. 21 is a schematic view of display areas, i.e. size and position of the display, selectable in the 
image display on the display means 4. In this embodiment there are selectable five display areas 1 to 5, in 
which 1 to 4 respectively correspond to rectangular areas, each equal to 1/4 of the display face, while 5 
corresponds to the full display face. 

In the following there will be explained the steps of the flow chart. The drawings at the right indicate the 

45 images provided to the observer at the respective steps. 

In the present embodiment, the direction of the visual line of the observer is constantly detected. 
Step 21: Turns on a switch for activating the function of the present invention. For this purpose, a switch 
mark is displayed, at a predetermined position within the display face, during the ordinary image 
observation, and, if the observer watches the false image of the switch mark for a predetermined time, the 

so visual line detecting means and the discrimination means 15 detect such watching state and initiate a 
switching operation of the displayed image in the following sequence: 

(1) The visual line detecting means detects the direction watched by the observer. 

If the position of the visual line coincides with the switch mark or the vicinity thereof, the 
discrimination means 15 stores the direction of the visual line, as first visual line information, in a 
55 memory, and the sequence proceeds to (2). 

If the detected direction does not coincide with the switch mark, the discrimination means identifies 
that the observer does not wish to switch th displayed image, so that the sequence does not proceed to 

(2) . 
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(2) After the lapse of a predetermined time, the discrimination means 15 detects, by the visual line 
detecting means, the direction watched by the observer. 
If the detected direction coincides with the switch mark, the discrimination means 15 judges that the 
observer has watched the switch mark for the predetermined time, and sends a signal to the control means 
5 16 to turn on the switch. Then the sequence proceeds to a step 22. 

On the other hand, if the detected direction does not coincide with the switch mark, the sequence 
returns to (1). 

By repeating the above-explained steps, the switching operation for the displayed image is securely 
started when the observer watches the switch mark for the predetermined time. 
w Step 22: When the switch is turned on, the control means 16 displays, for example, five points shown in 
Fig. 22, on the display face of the display means 4. Thus the observer sees an image 22a in Fig. 20. 

Step 23: Determines the display area. The observer watches a point, representing the desired display 
area, for a predetermined time, and the visual line detecting means and the discrimination means 15 
identifies the point watched by the observer for the predetermined time, within the image 22a, in the 
75 following sequence: 

(1) The visual line detecting means detects the direction watched by the observer, and the discrimination 
means 15 identifies whether the detected direction coincides with any of the five points. If the detected 
direction coincides with any of the points, the detected direction or position is stored, as first visual line 
information, in a memory. 

20 If the detected direction does not coincide with any of the points, the detection of the visual line is 

continued until the visual line is detected to any of the points. 

(2) After the lapse of a predetermined time, the discrimination means 15 detects, by the visual line 
detecting means, the direction watched by the observer, and obtains second visual line information. 

(3) The discrimination means 15 compares the detected direction of visual line with that corresponding to 
25 the point stored in the memory. 

If two directions mutually coincide, the discrimination means judges that the point corresponding to the 
detected direction is the point desired by the observer for image display and sends the corresponding 
information to the control means 16, and the sequence proceeds to a step 24. 

If the two directions do not mutually coincide, the sequence returns to (1). 
30 The point watched by the observer is determined by repeating the above-explained steps. 

In this manner, when the observer watches a point for a predetermined time, a display area is uniquely 
determined corresponding to said point. 

Step 24: The control means 16 displays an image in the display area determined in the step 23, by 
varying the size and position of the display of the image, by applying suitable image processing to the 
35 image information. For example, if the point 5 shown in Fig. 21 is selected, the image is displayed in full 
size of the display face. If the point 4 is selected,, the image size is changed to 1/4 of the display face and 
is displayed at the lower right part thereof, as shown in 24a. However the switch mark is separately 
displayed anew. 

The switching of the displayed image is thus completed. 
40 In the present embodiment, as explained in the foregoing, the size and position of the false image of 
the displayed image to be superimposed can be varied, in the course of image observation and according 
to the situation of the external image, by merely directing the visual line of the observer to a specified 
position within the viewing field, without any manual operation, so that there is attained extremely 
satisfactory operability. Besides, in the present embodiment, the entire device can be compactized by 
45 partial common use of the image observation optical system for observing the displayed image and the 
visual line detecting optical system for visual line detection. 

In the foregoing embodiment the display area can be selected in five manners, but it is also possible to 
further increase the freedom of selection available to the observer. 

Also the switch turn-on operation may be conducted manually, 
so Figs. 23A and 23B are respectively schematic views showing optical paths in an observation optical 
system and a visual line detecting optical system in another optical system of the present invention, 
wherein components same as those in Figs. 19A and 19B are represented by same numbers. 

The present embodiment is different from that shown in Figs. 19A and 19B in that a transmissive liquid 
crystal device (shield member) 11 is provided outside the face 6 of the second optical member in order to 
55 intercept the light beam, or a part thereof, entering the prism block 3 from the outside. Such interception of 
the incoming light eliminates the overlapping of the external image with the false image Y of the displayed 
image, thereby enabling clear observation of the latter. 
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The prism 10, the first optical member 3A etc. constitute a part of the image observation optical 
system, while the image observation optical system, the second optical member 3B and the liquid crystal 
device 11 constitute a part of the observation optical system. Also the light source 12, the first optical 
member 3A, the prism 10, the imaging lens 8, the image sensor 9 and the visual line detecting circuit 14 
5 constitute a part of the visual line detecting means. 

The function of displayed image observation by the image observation optical system and that of the 
visual line detecting optical system in the present embodiment are same as that in the foregoing 
embodiment shown in Figs. 19A and 19B. 

In the following there will be explained the control sequence of the present embodiment, with reference 
10 to a flow chart shown in Fig. 24. The drawings at the right-hand side of the flow chart schematically 
illustrate the images provided to the observer in the respective steps. 

In the present embodiment, the direction of visual line of the observer is constantly detected. 

Step 61: Turns on a switch for activating the function of the present invention. As in the foregoing 
embodiment, when the observer watches, for a predetermined time, a false image of a switch mark 
75 displayed as a spot in a part of the displayed image, superimposed with the external image, the visual line 
detecting means and the discrimination means 15 detect such watching state and initiate a switching 
operation of the displayed image. 

Step 62: Enters the display size information of the displayed image. The control means 16 displays, for 
example, a false image of a displayed image 62a, for observation by the observer. Said image includes, for 
20 example, a full-sized rectangular display frame S1, a rectangular frame S2 which is 1/2 in size in the vertical 
and horizontal directions, and a rectangular frame S3 which is 1/4 in size. 

Each display frame has a watching mark at a corner (upper right corner in the illustrated example). 
When the observer watches, for a predetermined time, the watching mark belonging to a desired frame, the 
visual line detecting means and the discrimination means 15 detect such watching state and judge that the 
25 observer has selected the corresponding display size, whereupon the display size is determined and the 
corresponding information is supplied to the control means 16. (The sequence for this operation is similar to 
that already explained in the step 23 of the foregoing embodiment.) Such selecting procedure from a limited 
number of display frames enables rapid setting of the display size, though fine adjustment of the display 
size is not possible. As an example, let us consider a case of selecting the frame S2. 
30 Step 63: Enters the display position information of the displayed image. The control means 16 displays, 
for example, a false image of a displayed image 63a, in which the full-sized display face is divided into 
grating-patterned areas of a suitable number, in superposition with the external image. Then the observer 
watches, for a predetermined time, a desired image display position (for example marked with "x") in these 
areas. In response, the visual line detecting means and the discrimination means 15 determine the display 
35 position in the following sequence: 

(1) The visual line detecting means detects the position watched by the observer in the grating pattern, 
and the discrimination means 15 stores the detected area number, as first visual line information, in a 
memory. 

(2) After the lapse of a predetermined time, the discrimination means 15 detects, by the visual line 
40 detecting means, the position watched by the observer in the grating pattern, and the detected area 

number is taken as second visual line information. 

(3) The discrimination means 15 compares thus detected area number with that stored in the memory. 

If the two area numbers mutually coincide, the discrimination means 15 judges this area as the image 
display area desired by the observer, and sends the corresponding information to the control means 16. 
45 Then the sequence proceeds to a step 64. 

If the two area numbers do not coincide each other, the memorized area number is replaced by the 
newly detected area number, and the sequence returns to (2). 

The display position desired by the observer is determined by repeating the above-explained steps. 
This procedure enables secure entry of the position information and avoids erroneous input, even if the 
50 visual line of the observer is somewhat shifted, as long as the observer watches the vicinity of the desired 
area for a predetermined time during the input state of the position information. 

Step 64: The control means 16 discriminates whether the image of the designated size can be 
displayed around the display position designated by the observer. 

If such display is possible, the display area is thus determined and the sequence proceeds to a step 

55 65. 

On the other hand, if the displayed image P1 around the designated position overflow the display face 
as indicated in 64a, the sequence proceeds to a step 66. 



29 




EP 0 687 932 A2 



Step 66: Effects calculation for shifting the display position of the displayed image P1, for determining a 
display area P2, allowing to retain the designated size of the image P1 with a minimum shift of the display 
position. 

Step 65: The control means 16 shifts the transmittance of the liquid crystal device 11 to zero in the 
5 image overlapping portion as indicated in 65a, thereby shielding the external image in said portion and 
avoiding the interference of the external image with the false image of thus determined display image. 

Step 67: The control means 16 displays the image in the display area determined in the steps 64 and 
66, by varying the size and position of display of the image by applying suitable image processing to the 
image information. The switch mark is displayed separately from the overlapping area. 
10 The switching of the displayed image is thus completed. 

In the present embodiment, as explained in the foregoing, the size and position of the false image of 
the displayed image to be superimposed can be varied, in the course of image observation and according 
to the situation of the external image, by merely directing the visual line of the observer to a specified 
position within the viewing field, and the external image in the superimposed portion is suitably shielded by 
is a shield member. Thus there is attained an observation optical device, featured by extremely satisfactory 
operability, not requiring any manual operation for varying the displayed image, and allowing clear 
observation of the false image Y of the displayed image. 

The display size may also be entered for example by displaying a linear pattern, of which an end 
corresponds to the full-sized image frame while the other end corresponds to the 1/4-sized image frame, 
20 and judging the display size desired by the observer in analog manner, based on the position watched by 
the observer on the linear pattern. In this manner the observer can enter, in considerably precise manner, 
the proportion of display size with respect to the maximum display size. 

In the present embodiment, a grating pattern is displayed at the entry of the display position, but such 
grating pattern display may be dispensed with. 
25 Based on the above-explained configuration, the present invention provides an observation optical 
device of excellent operability capable of arbitrarily varying the size and position of display of the false 
image for observation of the image displayed on the display face, in the course of observation of such false 
image or of observation of such false image spatially overlapped with the external image, to specified 
positions within the viewing field, according to the wish of the observer or to the external situation, utilizing 
30 the visual line of the observer. 

Furthermore there is provided an observation optical device capable of shielding a part of the external 
image where the false image of the displayed image is overlapped, thereby enabling extremely clear 
observation of such false image. 

A display device for displaying information is provided with an optical system for guiding the light of the 
35 display device to the eye, the optical system having, in the order in the proceeding direction of the light, an 
entrance face for receiving the light, a curved face for totally reflecting the light and a reflecting face 
concave to the eye side and adapted to reflect the light toward the eye. The reflected light is transmitted by 
the curved face and reaches the eye. Thus there is obtained a compact display device with satisfactorily 
suppressed aberrations. 

40 

Claims 

1. Display means for forming information, characterized by having optical means for guiding the light from 
said display means to the eye, said optical means including a curved face for totally reflecting the light. 

2. Display means according to claim 1. wherein said optical means includes, in the order in the 
proceeding direction of light, an entrance face for introducing the light from said display means, said 
curved face and a reflecting face for reflecting the light toward the eye, wherein the light reflected by 
, said reflecting face is transmitted by said curved face and reaches the eye. 

3. Display means according to claim 1 , wherein said curved face has variable optical power depending on 
the azimuthal angle. 

4. Display means according to claim 1 , satisfying a condition jaj £ 20° wherein a is the angle between the 
55 tangential line to said curved face at the vertex thereof and a line perpendicular to the optical axis of 

the eye. 
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5. Display means according to claim 1, further comprising: 

illumination means for illuminating the eye; and 

light-receiving means for receiving the light reflected from the eye, for detecting the visual line 
thereof. 

5 

6. Display means according to claim 5, further comprising: 

control means for controlling the display state of said display means, according to the light 
receiving state of said photosensor means. 

io 7. Display means according to claim 2, wherein said reflecting face is a half-transmitting face. 

8. Display means according to claim 2, wherein said reflecting face has variable optical power depending 
on the azimuthal angle. 

15 9. A display device comprising: 

information forming means for forming an information: 

optical means for guiding a light of said information forming means to an eye, in which said optical 
means have a reflecting curved face decentered having a positive optical power; 

illuminating means for illuminating said eye; 
20 converging means for converging a light of said illuminating means reflected from said eye; and 

detecting means for receiving a light from said converging means to detect a state of said eye; 

wherein where an imaging magnification of said converging means is 0, a following condition is 
satisfied, 

25 0.02 < | 0 | < 0.18. 

10. A display device according to claim 9, wherein said reflecting curved face has variable optical power 
depending on the azimuthal angle. 
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